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Abstract 

This paper studies the optimal power allocation for outage minimization in point-to-point fad- 
ing channels with the energy-harvesting constraints and channel distribution information (CDI) at the 
transmitter. Both the cases with non-causal and causal energy state information (ESI) are considered, 
which correspond to the energy harvesting rates being known and unknown prior to the transmissions, 
respectively. For the non-causal ESI case, the average outage probability minimization problem over a 

■ 

finite horizon is shown to be non-convex for a large class of practical fading channels. However, the 
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globally optimal "offline" power allocation is obtained by a forward search algorithm with at most N 
one-dimensional searches, and the optimal power profile is shown to be non-decreasing over time and 
have an interesting "save-then-transmit" structure. In particular, for the special case of N = 1, our 
result revisits the classic outage capacity for fading channels with uniform power allocation. Moreover, 
1 for the case with causal ESI, we propose both the optimal and suboptimal "online" power allocation 

C$ , algorithms, by applying the technique of dynamic programming and exploring the structure of optimal 

offline solutions, respectively. 
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I. Introduction 

Traditional energy-constrained wireless communication systems, e.g., wireless sensor networks, are 
equipped with fixed energy supply devices such as batteries, which have limited operation time. When a 
sufficient number of sensors run out of battery, the whole network may fail. Therefore, for applications in 
which replacing batteries is inconvenient or even impossible, e.g., in hostile or toxic environment, energy 
harvesting (EH) becomes an alternative solution to provide almost unlimited, easy, and safe energy 
supplies for wireless networks. However, compared with conventional time-invariant energy sources, 
energy replenished by harvesters is usually intermittent over time, e.g., with energy fluctuation caused 
by time-dependent solar and wind patterns. As a result, wireless devices powered by renewable energy 
sources are subject to explicit EH constraints over time, i.e., the total energy consumed up to a given 
time must be less than the energy harvested by that time. 

Wireless communication with EH nodes has recently drawn significant research interests (see, e.g., 
(U— Q). In (3l, S, the authors investigated the throughput maximization problem over a finite number 
of transmission blocks for both the cases with a deterministic EH model (for which the energy amount and 
arrival time are assumed to be known a priori at the transmitter) and a random EH model (for which only 
the statistics of the EH process is known). In j5j, the authors studied the throughput maximization problem 
for the three-node relay channel with the deterministic EH model and the decode-and-forward (DF) 
relaying scheme. From an information-theoretic viewpoint, the authors in 0, Q derived the capacities 
for the additive white Gaussian noise (AWGN) and fading channels with random EH sources, respectively, 
where it was shown that assuming an infinite energy storage volume, the same channel capacity can be 
achieved as the cases with conventional constant power supplies. 

The aforementioned works about the EH systems in fading channels investigate the maximum achiev- 
able average throughput over a long term. It is worth noting that for conventional cases with constant 
power supplies, the information-theoretic limits of fading channels have been thoroughly studied in the 
literature (e.g., see (8l and references therein) for both the cases without and with a transmission delay 
constraint, termed as the ergodic capacity and the outage capacity, respectively. Specifically, with the 
perfect channel state information (CSI) known at both the transmitter and the receiver, the ergodic capacity 
is achieved by a random Gaussian codebook with infinite-length codewords, which span over all different 
fading states [9]. To maximize the ergodic capacity, it was shown in (9[ that the so-called "water-filling" 
power allocation is optimal. Under the same CSI assumption, the outage probability minimization problem 
for block-fading channels with delay-constrained transmission has been studied in |[T0l , where the optimal 
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power allocation is shown to have a "truncated channel inversion" structure. With perfect CSI known 
at the receiver but no CSI is known at the transmitter, the ergodic capacity of block-fading channels is 
achieved by a constant transmit power allocation over all the fading states |[T0l , ifTTl . Under the above 
CSI assumption, the outage capacity is defined as the maximum transmission rate subject to a given 
outage probability constraint |[T2l . |fT31 , where the transmit power is assumed to be constant over all 
transmission blocks. 

In this paper, we consider the transmissions of delay-constrained traffic at a constant rate over block- 
fading channels, where the CSI is perfectly known at the receiver but only the channel distribution 
information (CDI) is known at the transmitter. Under such assumptions, we investigate the average (over 
time) outage probability minimization problem over a finite horizon of N EH periods, each of which 
contains M communication blocks, with the harvested power during each EH period being constant, 
denoted by Qi, 1 < i < N. In particular, we consider the following two types of EH models: 

1) Non-causal energy state information (ESI): All Qi's are assumed to be known at the transmitter 
prior to the transmissions. In this case, we are interested in developing the optimal offline power 
allocation to minimize the average outage probability. 

2) Causal ESI: At the i-th EH period, i = 1, 2, ■ ■ ■ , N, only Qi, - ■ ■ ,Qi are known at the transmitter. 
For this case, we are interested in developing various online power allocation algorithms based on 
the statistical properties of the EH rates Qi's. 

Note that if N = 1, both the cases with non-causal and causal ESI become identical. As such, with 
N = 1, we first examine the properties of the outage probability as a function of the transmit power for a 
large class of practical fading channel distributions, and show that the outage probability usually behaves 
as a "concave-convex" function. Due to this fact, it turns out that the outage probability minimization 
problem with power control subject to the EH constraints is in general non-convex. For the special case 
of N = 1, we show that this problem degrades to the classic outage minimization problem with an 
average power constraint over a finite horizon of M communication blocks. Although this simplified 
problem is still non-convex, we obtain its globally optimal power allocation with only a one-dimensional 
search by exploiting the properties of the outage probability function. The optimal solution is shown to 
have a threshold-based structure: When the average power is larger than a threshold determined by the 
transmission rate and the CDI of the fading channel, uniform power allocation is optimal; otherwise, the 
optimal power allocation corresponds to an "on-off" transmission. Interestingly, this result revisits the 
classic definition of the outage capacity for fading channels lfl2l with uniform power allocation only, by 
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revealing that a non-uniform (i.e., on-off) power allocation can yield a smaller outage probability in the 
low-power regime (or equivalently in the high-outage regime). Furthermore, we propose a suboptimal 
power allocation scheme based on the optimal threshold and on-off structures, which avoids the exhaustive 
search operation in the optimal solution and is shown to be asymptotically optimal as M goes to infinity. 

For the more general case of N > 1, we first look at the model wiht non-causal ESI, where we 
develop a forward search algorithm to compute the globally optimal offline power allocation for outage 
minimization, with at most N one-dimensional searches based on the results obtained for the case of 
N = 1. It is shown that the obtained optimal power profile is non-decreasing over time and has an 
interesting "save-then-transmit" structure similarly to that reported in |[T3l , Ifl4l under different problem 
setups. Furthermore, a suboptimal low-complexity power allocation algorithm is proposed to avoid the 
exhaustive search operations in the optimal algorithm, similar to the case of N = 1. 

For the causal ESI model with N > 1, we study the optimal online power allocation problem to 
minimize the average outage probability over a finite horizon, which is formulated as a Markov decision 
process (MDP) problem, and obtain the solution by applying dynamic programming and exploring the 
results obtained for the case of N = 1. We also propose a suboptimal power allocation scheme, which 
achieves a more flexible performance-versus-complexity tradeoff than the MDP-based solution. 

The remainder of this paper is organized as follows. Section II presents the system model and formulates 
the outage probability minimization problem. Section III presents some important properties of the outage 
probability function and applies them to solve the outage probability minimization problem for the case 
with N = 1. Section IV extends the results to the more general case of N > 1 with non-causal ESI. 
Section V addresses the power allocation problem for the causal ESI case with N > 1. Numerical results 
are presented in Section VI to validate the proposed algorithms. Finally, Section VII concludes the paper. 

II. System Model and Problem Formulation 

A. System Model 

In practical wireless systems, the duration of a communication block is usually on the order of 
millisecond, while the EH process evolves at a much slower speed, e.g., solar and wind power typically 
remains constant over windows of seconds. In other words, the coherence time of the EH process is 
usually much larger than the channel coherence time. As such, it is reasonable to assume that the EH 
process keeps constant over a sufficient number of communication blocks, during which the channel 
may change from block to block. In this paper, we consider the transmission over N EH periods, each 
of which contains M communication blocks, with a unite block length. During each EH period, the 
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harvested power level is assumed to be constant over the constituting M communication blocks, denoted 
as Qi, i = 1, • • ■ , N. For the time being, we assume that N and M are finite integers, and will address 
the case of M — > ocQ in Sections III and IV. We also assume that the battery capacity to store the 
harvested energy is infinite, and the consumed energy at the source other than the transmission energy 
is relatively small and thus negligible. 

We consider a block-fading channel, and the input-output relationship of the (i, j)-trj^] communication 
block is given by 

Vi,j = KjV^i~j x i,j + n M> i = I,-- - ,N, j = 1, - - - , M, (1) 

where yij is the channel output, Xij is the corresponding channel input with zero mean and unit average 
power, hij is the complex fading channel gain, P^j is the transmit power, and riij is the independent and 
identically distributed (i.i.d.) circularly symmetric complex Gaussian (CSCG) noise with zero mean and 
unit variance. In particular, the complex channel gain hij is assumed to be an i.i.d. random variable across 
the communication blocks, with zero mean and unit variance. Here, hij is unknown to the transmitter, 
but perfectly known at the receiver. 

For each communication block, the corresponding instantaneous mutual information of the channel 
assuming the optimal Gaussian codebook for the transmitted signals is given by 

Ii,j{h i:j , P id ) = log (1 + //,., 2 /',.,) , (2) 

where the logarithm is assumed to have base 2. In this paper, we assume that all NM communication 
blocks are transmitting with the same constant rate R; then, the outage probability at the (i,j)-th 
communication block is defined as 

P(Pij) = Pr {Iij(hij,Pij) <R} = Pr | \hij 2 < ^ • (3) 

Note that T(Pij) is the outage probability function in terms of the transmit power Pij, the fading 
channel gain hij, and the transmission rate R. Moreover, we assume that P(-) is strictly decreasing over 
its domain of Pjj > 0. 

'This scenario can be regarded as an approximation for the case with very large M, e.g., the wind usually changes in several 
seconds, during which thousands of communication blocks have been sent. 

2 We denote the index number of the j-th communication block in the i-th EH period as 
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B. Problem Formulation 

In this subsection, we formulate the average outage probability minimization problem over finite horizon 
for both the cases with non-causal and causal ESI. 

1 ) Non-causal ESI: For this case, we assume that the harvested power levels of all the N EH periods 
are known prior to the transmissions. Hence, the transmit power available for each communication block 
is limited by the following EH constraints: 

n m n—1 

J2^ p iJ < M^Qi + mQn, n = l,..- ,N, m = 1, • • • ,M, (4) 

i=l j=l i=l 

where the effect of block length (connecting power to energy) is normalized out by the unit-length 
assumption. Then, the average outage probability minimization problem over the finite horizon of NM 
communication blocks is formulated as 

N M 

(PI) min — VVjfPij) (5) 
{p t A NM ^ ^ v lJJ v ' 

s.t. dU, Pij > 0, 1 < i < N, 1 < j < M. (6) 

Since the constraints in © are all linear, the convexity of Problem (PI) is determined by that of the 
function T(-), which will be discussed later in Section III. Here, we show some properties of the optimal 
solution with an arbitrary T(-), which are summarized as the following two remarks. 

Remark 2.1: First, the optimal solution of Problem (PI) may not be unique. This is due to the fact 
that if the transmit power values over two arbitrary blocks are decreasing over time, we can switch them 
without violating the EH constraints and still achieve the same objective value. Thus, without loss of 
generality, in this paper we are only interested in obtaining the optimal power allocation of Problem (PI) 
that is non-decreasing over time, similarly to [|2]], Q. 

Remark 2.2: Second, it is worth noting that the last constraint in (0]) is always satisfied with equality 
by the optimal solution of Problem (PI). This is due to the fact that any residue power after the last 
communication block should be used in the last block to yield a lower average outage probability, since 
the outage probability function F(-) is assumed to be strictly decreasing. 

2) Causal ESI: For this case, we assume that only the past and current harvested power levels are 
known at the transmitter. Similar to |4], we assume that the EH process {Qi} is a first-order stationary 
Markov process over i, and its distribution P(Qi + \\Qi) is known at the transmitter. Then, the battery 
state Bij > at the beginning of the (i,j)-ih communication block is given by 

= Bij + Qi — Pij, (7) 
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where -Bij+i denotes the battery energy level at the beginning of the + l)-th_| communication 

block. Thus, it is easy to check that {Bij} also follows a first-order Markov model. For convenience, 
we assume zero initial energy storage, i.e., Bn = 0. 

Therefore, for the n-th EH period, the minimum average outage probability with known Q n is obtained 
by solving the following problem 



M 



(P2.n) T:= min V^(P n ,, 



+ E 



N M 
i=n+l j=l 



Qn 



s. t. < Pi.j < B id + Qi, n < i < N, 1 < j < M. 



(8) 



(9) 



It is worth noting that only Q n is known to the transmitter, and Q n +i, ••• ,Qn ar e random variables. 
The expectation in Problem (P2.n) is taken over {Q n+ \,--- ,Qn}', and P^j, n + 1 < i < N and 
1 < J < ^> is a function of {Q n+ i, • • • , Qj} and {P n ,i, ■■■ , Pu,m}- For convenience, we denote the 
group of Problems (P2.n), n = 1, ■ ■ ■ , 7Y, as Problem (P2). It is easy to verify that Problem (P2) is a 
MDP problem, for which the optimal solution will be studied in Section V. 



III. Optimal Power Allocation for the Case of N = 1 

In this section, we first present some important properties for the outage probability function T(-), 
and then apply them to derive an optimal power allocation for Problems (PI) and (P2) for the special 
case of N = 1, as well as a suboptimal power allocation scheme with lower complexity. Since N = 1, 
the obtained power allocation algorithms apply to both the cases with non-causal and causal ESI. 



A. Properties of Outage Probability Function 

In this subsection, we first show some interesting properties of the outage probability function, based 
on which we define two types of outage probability functions for different fading channel distributions. 
Without loss of generality, we adopt Weibull fading |[T6l as an example, from which we later draw a 
general result for other fading distributions. For convenience, we omit the subscript for hij and 
Pij in this subsection. 

With Weibull fading, the complex channel coefficient h can be written as |fT6l 

h = (X+jYfP, (10) 
3 {i,j) + 1 is defined as the index of the next communication block after the (i, j)-th one. 
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Transmit power 



Fig. 1. Outage probability versus transmit power for Weibull fading with different fading parameters /3, with R — 3 bits/sec/Hz. 



where X and Y are i.i.d. Gaussian random variables with zero mean and identical variance satisfying 
E (|/i| 2 ) = 1, and /3 is a parameter controlling the severity or the diversity of the channel fading fl31 . 
with p > 0. It is observed that when (3 = 2, Weibull fading degrades to the well-known Rayleigh fading. 
The probability density function (PDF) of \h\ is given as /(r) = fir 13 " 1 exp (— r' 3 ), with r = \h\ > 0, 
and thus the corresponding outage probability function is given as lfT6l 



HP) = 1 - exp I- ^— — J J. (11) 

In Fig. [TJ we plot the outage probability function versus transmit power for Weibull fading. It is 
observed and also can be verified (see Preposition 13.11 below) that for all cases with different values of 
/3, the outage probability function is non-convex. Recall that j3 is an indicator of the "diversity order" 
lfl"5l of the Weibull fading channel (larger values of /3 imply higher diversity orders). Thus, the Weibull 
fading model is quite general for modelling practical fading channels with different degrees of diversity. 

Next, we obtain the following result on the convexity of the outage probability function with Weibull 
fading. 

Proposition 3.1: The outage probability function given in (fTTT) is concave over P € [0, Pb] and convex 
over P £ [P&, +oo), where 

M^r* 2 *-^ (,2) 
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Proof: By obtaining the second-order derivative of T(P) in (fTTT ). it follows that 

r(P) = -§ (2* - l)"' 2 P^-exp (- (^)"") (§ (2« - 1)>* - (§ + 1)) . 

We thus have 7"" (P) < over < P < P b and J""(P) > over P > P b , which means that F{P) is 
concave when P > Pb and convex when < P < Pb- Thus, the proposition is proved. ■ 

Besides P\, we now give another important parameter for the outage probability function as follows. 

Proposition 3.2: There exists a value P a , with P a > Pb, such that all the points (P, P(P)) on the 
outage probability curve given in (fTTT) are above the straight line passing through the two points (0, 1) 
and (P a ,T(P a )), i.e., 

.F(P) > ' F ( Pa ' 1 P + l, VP > 0. (13) 

Pa 

Proof: See Appendix lAl ■ 
In general, it is difficult to obtain the closed-form expression for P a . However, we can obtain the value 
of P a by a simple bisection search summarized as Algorithm U in Table H for which the main ideas are 
given as follows: For a given point P a , denote the function of the straight line connecting points (0, 1) 
and ^P a ,P (^")) as 9(Pa'i x )> which is defined as 

g(P a ;x) = T{Pa J~ 1 x + l. (14) 

Pa 

If P a < P a , it is observed that there exists an 5 > such that g(P a ;x) < P(x) for x G (P a — S,P a ) 
and g(P a ;x) > T(x) for x € (P a ,P a + 5); otherwise if P a > P a , it is observed that there exists an 
5 > such that g{P a ;x) > T{x) for x G {P a — 5,P a ) and g{P a ]x) < P(x) for x G {P a ,P a + 8). 
According to the above property, we design the following algorithm to search for P a , which returns an 
x G (P a — e, P a + e) with a prescribed tolerable error < f « 1. 

TABLE I 

Algorithm^] Bisection search for P a defined in Proposition s. 21 



Initialize ai ow = 0, a up (any sufficiently large positive number), and the error tolerance e; 
While a up — a\ 0VI > e, repeat the following steps 
1) Let P a = """tp - 



2) If g(P a ; Pa-e) < T(P a - e) and g(P a ; P a + e) > T(P a + e), let a low = P Q ; 

3) Else let a up = P a . 
Algorithm ends. 
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In Fig. [TJ for the case of /3 = 8, we show the two points P a and Pb. For other types of fading channel 
distributions, e.g., Rician fading and Nakagami fading, it can be shown that their outage probability 
functions have similar properties to the above for Weibull fading; however, unlike Weibull fading, Pj, 
may no longer be expressible in a closed-form as that in (8), and can only be computed numerically. 
Moreover, for certain fading distributions, it is possible that the outage probability function is convex 
over the entire range of P > 0, which can be regarded as a special case with P a = Pb = 0. With the 
above observations, we categorize the outage probability functions for fading channel distributions in the 
two following types. 

Definition 3.1: An outage probability function T(x), x > 0, is said to be Type A, if F{x) is convex 
over x > 0. 

Definition 3.2: An outage probability function F(x), x > 0, is said to be Type B, if there exist two 
points < Pb < P a , such that: 

1) F{x) is concave over [0,P o ] and convex over (Pb, oo); 

2) T(x) is always above the line g(x), passing through the two points (0,1) and (P a ,F(P a )), i.e., 
Fix) > g(x), x > 0. 

Here, a Type B function is with a "concave-convex" shape, while a Type A function is a special case 
of Type B functions with P a = Pb = 0. It can be verified that Weibull fading, Rician fading, Nakagami 
fading, and double Rayleigh fading in general lead to Type B outage probability functions. However, we 
need to point out that an arbitrary outage probability function can be neither Type A nor Type B, which 
is out of the scope of this paper. 

Remark 3.1: It is worth noting that if T(-) is with Type A, Problem (PI) is convex. Thus, existing 
power allocation algorithms in 0, |4), Q can be applied to solve this problem. As such, in the rest of 
this paper we are mainly interested in the case of Type B outage probability functions. 

B. Optimal Power Allocation with N = 1 

In this subsection, we solve Problems (PI) and (P2) for the special case of N = 1, based on the 
previously derived outage probability function properties. Here, since N = 1, we use the notation Pj 
instead of P± t j for convenience. 

Instead of solving Problem (PI) with = 1 directly, we consider the following problem by removing 
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the first M — 1 constraints in (0]), i.e., 




M 



(P3) 



(15) 



M 



S.t. 



(16) 



Obviously, Problem (P3) is a relaxed version of Problem (PI) with N = 1, which provides a lower bound 
on the optimal value of Problem (PI). We will show next that since there exists a non-decreasing optimal 
solution of Problem (P3) that is guaranteed to satisfy the omitted M — 1 constraints in (O, the solution 
for Problem (P3) is also optimal for Problem (PI) with N = 1. 

It is easy to see that Problem (P3) is also a power allocation problem to minimize the average outage 
probability over a M-block block-fading channel with an average power constraint. If P{Pj) is a non- 
convex function (e.g., Type B function), Problem (P3) is non-convex ifTTl , and thus difficult to be solved 
by conventional convex optimization techniques. To provide a solution, we first present some structural 
properties of the optimal power profile of Problem (P3) as follows. 

Proposition 3.3: For the optimal solution of Problem (P3), there is at most one strictly positive power 
value P* that is below P& defined in Proposition 13 -It 

Proof: This proposition is proved by contradiction. Suppose that for the optimal power profile P*'s 
of Problem (P3), there exist ji and j 2 , 1 < ji,j 2 < M, such that < P* < P* < P b . Since 
P(x) is assumed to be concave over [0, p,], define < e < p, — P* and it is easy to check that 
P(Pj ± ) + F{Pj 2 ) > P(Pj* — e) + F{Pj 2 + e) , which means that a new power allocation, with Pj 1 = P* — e 
and Pj 2 = Pj 2 + e, yields a lower outage probability and this contradicts with the optimality of P*'s for 
Problem (P3). Therefore, this proposition is proved. ■ 

Proposition 3.4: For Problem (P3), all optimal power values P/'s, that are above P& defined in 
Proposition 13.11 are identical. 

Proof: The proof is similar to that of Proposition 13.31 by considering the convexity of the function 
jF(x) over the region [p,,+oo). ■ 

Remark 3.2: Based on Propositions 13.31 and 13.41 it follows that the optimal solution of Problem (P3) 
should have the following structure: There are at most one block assigned with power Pq, < Po < P&, 
k* blocks, < k* < M, assigned with identical power A/<3 fc 1 .~ p ° > P b , and M — k* — l blocks with zero 
power. Thus, solving Problem (P3) is equivalent to finding the values for k* and Pq. 

Besides p,, P a defined in Proposition 13.21 also plays an important role in solving Problem (P3). As 
shown in Appendix |B] it is always desirable to allocate the available power to be close to P a when 
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or k* 



Pa 



M 



+ 1, 



Qi < P a . As such, the desired k* in Remark I3T21 should be either k* 
where [x\ denotes the flooring operation, and Pn can be obtained by a one-dimensional search. Therefore, 
we obtain the following theorem on the optimal solution of Problem (P3). 
Theorem 3.1: The optimal solution of Problem (P3) is given as follows: 

1) If Qi > Pa, P* = Qi, 1 < j < M; 

2) If Q a < P a , 



p* 

3 



0, 
Po, 

MQi 



where ko and Po are given as follows: 

Qi 



kn 



Pn 



k 



M 



l<j<M-k -l 

j = M-k 

M - k + 1 < j < M 



(17) 



Pn = ar ff mm P(P) + ^0-P i 



(MQx-P 



(18) 
(19) 



withP = [0,P 6 )Uf§. 

Proof: See Appendix iBl ■ 

It is worth noting that only a one-dimensional search is needed to compute the optimal power allocation 
for Problem (P3) when Q\ < P a . As explained in Appendix IB] since we cannot claim any mono tonicity 
results on the right hand side of (Tf9l) . an exhaustive search is necessary. 

Remark 3.3: It is worth pointing out that the outage capacity results in the literature for fading channels 
without CSI at the transmitter are usually based on uniform power allocation over all the communication 
blocks. However, Theorem [3J] reveals that uniform power allocation can be sub-optimal for certain fading 
channel distributions (e.g., Type B fading) in the case of Q\ < P a , which correspond to a low-power 
regime or equivalently a high-outage regime. 

Since the solution given in Theorem l3.1l is non-decreasing and always satisfies the first M— 1 constraints 
in (01), we obtain the following corollary. 

Corollary 3.1: The optimal solution obtained in Theorem 13.11 for Problem (P3) is also optimal for 
Problem (PI) with N = 1. 

Remark 3.4: Theorem 13.11 shows that in the low-power regime, uniform power allocation may be non- 
optimal, while on-off power allocation achieves the minimum outage probability. It is easy to check that 
as M goes to infinity, the optimal power allocation for the case of Q\ < P a converges to the following 
binary power allocation: The source transmits with power P a over fraction of the total blocks, and 
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L^-MJ - %-M 



0. 



keeps silent in the rest of blocks. This is due to the following facts: 1) limM-^oo 
which means that k -> as M ->■ oo; and 2) j^k p a an d thus Mgpgb _^ p a a s M — ^ oo for 

any finite Pq, which implies that to satisfy the average power constraint, we should have Pq —> 0. 

Remark 3.5: Compared to the conventional uniform power allocation lfT2l . the performance gain in the 
low-power regime with the optimal power allocation is expected to be more substantial as P a increases. 
Taking Weibull fading as an example, it is easy to see that a larger /3 corresponds to a larger P a . Therefore, 
we conclude that for the fading channels with higher diversity orders, the performance gain will become 
more notable, for any given Q\ < P a . 

C. Suboptimal Power Allocation with N = 1 

From Theorem 13 - H it is observed that the threshold P a plays an important role in the optimal power 
allocation: If Q\ < P a , all the non-zero power values, except at most one that is below Pb, are identical 
and as close to P a as possible. This implies that an on-off two-level power allocation strategy may 
perform close to the optimal allocation. To avoid the exhaustive search in obtaining the optimal solution, 
we can simply allocate the power uniformly in the "on" state, such that we only need to determine how 
many blocks should be in the "on" state. As such, we propose the following on-off power allocation 
scheme for the case of Q\ < P a as follows: 

0, 1< j < M - k 
Pj = \ 1 , (20) 

P, M-k + l<j<M 



where 

ko 



Qi 



~ MQi 

P = — ^i; (21) 



while for the case of Qi > P a , the source transmits with power Qi for all M blocks, the same as 
Theorem 13. II Obviously, when M goes to infinity, (1201 is asymptotically optimal according to Remark 
13.41 i.e., P — > P a . We thus have the following proposition. 

Proposition 3.5: The power allocation in (1201 is asymptotically optimal for Problem (PI) with N = 1 
as M goes to infinity. 

IV. Offline Power Allocation for the Case of N > 1 

In this section, we derive the optimal and suboptimal solutions of Problem (PI) for the general case 
of N > 1 with non-causal ESI. 
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A. Optimal Offline Power Allocation with N > 1 

First, we give the following results on the structures of the optimal solution to Problem (PI) with 
N > 1. 

Proposition 4.1: For the optimal solution of Problem (PI), there is at most one strictly positive power 
Pi j that is below defined in Proposition 13.11 

Proof: The proof is similar to that of Proposition 13.31 and thus omitted for brevity. ■ 

Proposition 14. 1 1 implies that if the available transmit power for any communication block is below the 
value P\, the source should not transmit with at most one exceptional case until more energy is harvested 
to make the available power above P^. In addition, for Problem (PI), if the optimal power values P*j 
and P*j + \ for two consecutive communication blocks are both larger than Pf,, we obtain the following 
properties for a non-decreasing optimal power profile. 

Proposition 4.2: For the non-decreasing optimal solution of Problem (PI), any two consecutive transmit 
power values that are both larger than P^ must satisfy the following two conditions: 

1) If the EH constraint at the (z, j)-th block is not achieved with equality, we have P*j = P*j + \', 

2) From 1), we infer that if P*j < P*j + \, the EH constraint at the (z,j)-th block is achieved with 
equality. 

Proof: To show the first condition, we first assume that P*. < P*j + i- It is easy to check that a new 

~ ~ p.* . — p* . 

power profile, defined as Pjj = P*~ + e and Pij+i = Pjfj+i ~ e > with < e < ' ,J+1 2 — — , leads to a 

lower average outage probability, which contradicts with the optimality presumption. Therefore, the first 

condition is proved. Then, the second condition could be easily proved by using the first condition and 

the non-decreasing property. ■ 

Remark 4.1: From Propositions 14. 1 1 and 14.21 we conclude that the optimal solution of Problem (PI) for 
the case of N > 1 with the non-decreasing power profile must posses the following "save-then-transmit" 
structure: Initially, the transmitter keeps silent for a certain number of communication blocks; then, it 
(possibly) transmits with a power smaller than P\ over one communication block; after that, it keeps 
transmitting with power larger than Pi, and increases power levels right after the EH period where the 
harvested energy is exhausted due to 2) in Proposition 14.21 

Based on the above structure, we propose an algorithm, namely Algorithm IH to compute the globally 
optimal solution of Problem (PI) with N > 1, which is summarized in Table ITT1 The proposed algorithm 
mainly addresses the following two questions: i) when the transmission should start; and ii) how to 
determine the following parameters: the first positive transmission power Pq, which might be smaller than 



December 4, 2012 



DRAFT 



15 




— Harvested power profile 
• Optimal power allocation 
o First-round search result 



12 3 4 



Fig. 2. An example of the optimal power allocation solution for Problem (PI) with N = 6. 



Pfe, and ko, which is the number of communication blocks with identical power value Pi immediately 
after the first communication block with positive power value Po. If these two issues are solved, the 
remaining power allocation can be computed efficiently by Algorithm III in Q, since the the remaining 
part will be operated in the convex region of the function T(-). It will be shown next that the above two 
problems are equivalent to finding an EH period with index such that the result in Case 2) of Theorem 
13.11 could be applied from the first to the i^-th EH periods to obtain the corresponding parameters ko, 
P , and Pl 

Before presenting the general algorithm, we show an example in Fig. |2] to illustrate the main ideas 
involved. The proposed algorithm implements a forward search from the first to the iV-th EH period, in 
order to determine a particular EH period (indexed by ij) within which there is one (if any) communication 
block with a positive power value below P&. As shown in Fig. |2j the following cases may occur in this 
search: 

1) The harvested power values Q\ and Q2 over the 1st and 2nd EH periods are below P a . It is then 
claimed that > 2 and we should continue the searching; 

2) At the 3rd EH period, it is observed that Q3 < P a and Q4 > P a . Therefore, we claim that the 
optimal power allocation may be no smaller than P a after the 3rd EH period, i.e., ij= 3, and thus 
the power allocation from the first to the 3rd EH periods can be computed similarly as Case 2) in 
Theorem 13.11 with equivalent average power | (Qi + Q2 + Q3) and the number of blocks 3M, by 
which we obtain ko, Po, and P\. 

Next, we allocate the obtained power values to the blocks starting from the (3, M)-th one in a 
backward manner to obtain a non-decreasing (in term of a forward direction) power profile, as 
shown by the circles in Fig. [2] It is easy to see that this power profile satisfies all the EH constraints 
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up to the end of the 3rd EH period. However, since the obtained power value in the 3rd EH period 
is larger than the harvested power in the 4th EH period (which violates the non-decreasing power 
allocation for the optimal solution), we conclude that it cannot be optimal. Thus, we claim % = 4 
and use Theorem 13. II to update ko, Pq, and Pi with the new average power | (Qi + Q2 + Q3 + Q4) 
and the total number of blocks 4M. Similarly, we obtain the new power profile from the first to 
the 4th EH periods, as shown by the dots in Fig. [2] Then, it is observed that the obtained power 
values satisfy the following two conditions: i) the power values in the 4th EH period are smaller than 
the average harvested power in the 5th and 6th EH periods (To comply with the optimal condition 
given in Proposition 14.21 ); and ii) even if we raise the power value Pi by |r and correspondingly 
set Pq = 0, the new Pi is still no larger than the average harvested power in the 5th and 6th EH 
periods (This condition guarantees that no larger-scale search is needed). As such, we conclude that 
%j= 4 is optimal for Problem (PI); 
3) In the 5th and 6th EH periods, the harvested average power is larger than both P a and the allocated 
power in the 4th EH period, and thus the source should transmit at this average power. Note that in 
the 5th EH period, the source needs to save certain power for the 6th EH period. 
By generalizing the above procedure, we next discuss the details of Algorithm [HI summarized in Table 
Hi] which provides the optimal solution for Problem (PI) with N > 1. Assume that before the i-th EH 
period, the optimal power profile is obtained as P* g , 1 < p < i and 1 < q < M. Compute the index 
i s corresponding to the next possible power exhausting EH period after the z-th EH period, and the 
possible constant power allocation value Pj from the i-th to the z s -th EH period, which are given by 



arg mm < ^— > , (22) 



i<n<N y n — i + 1 

P = Qo + E^Q* , (23) 
i s — i + 1 

where Qq is the residual power up to the i-th EH period with Qq = Ylk=i Qfc if P* m = for 1 < n < f 
and 1 < m < M. It will be shown later that if there exists P* m > for 1 < n < i and 1 < m < M, 
we have Qq = 0, due to the fact that the transmitter will only save power before certain EH period and 
after that, it will transmit with its best effort. Then, we have the following possible cases: 
1) Case I: If Pj > P a , it is claimed that the source should transmit with its best effort, and the optimal 

4 The power exhausting EH period means that at the end of this EH period, all harvested power is consumed. 
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power values are given as 



R 



Pi,(i,l) < M < (is,M), 



(24) 



where (m, mi) < (ri2, m<2) is denned as one of the following two cases: i) n\ < n^, and ii) n\ = n-i 
and mi < mi, with the equality achieved only when n\ = 77,2 and m\ = m^, set i = i s + I, and 
continue the search procedure. 
2) Case II: If Pj < P a , we need to determine a search region (from the i-th to the i s , ^-th EH period, 
t > 0), where a power value below P& exists and the result in Case 2) of Theorem 13.11 can be 
implemented. Then, we recursively compute the index i s +t, t = 1, 2, • • • , of the next possible power 
exhausting EH period after the i s+t _i-th EH period and the corresponding power value Pi + t from 
the z s+t _i-th to the i s +t-th EH period as: 



is+t 



P, 



arg mm 

i s+t _!+l<n<AT 



En 
k= 



: « s +t-i+l 



Qh 



n - i a +t-i 



i+t 



is+t — ls+t-1 

Then, we consider the following two cases: 
a) If there does not exist any to > 1 such that 



(25) 
(26) 



Pi+t < Pa, Pi+ta+l > Pa, 



(27) 



we obtain that py < Pa, and thus claim that i s+ j = 7Y. Then, we apply the same searching 
procedure as shown in Case 2) of Theorem 13.11 among the i-th to the i s+ ]~ th EH periods with a 
total energy budget of M^ t=0 (i s +t — is+t-i) Pi+t, and compute the index (io, jo) corresponding 
to the unique communication block with positive power value less than P& as follows: 



% s+t ' 



M 
ko - 



ko 




_M_ 





where 



fen 



M Yh=o tts+t ~ M-t-i) p i 



i+t 



Pn 



(28) 
(29) 

(30) 



with « s _i = i — l. Next, the optimal power value Pn of the (io, jo)-th communication block needs 
to be within the interval [0, Pn], where 

(i s+r -i + l)MP 



Pn 



ko + l 



(3D 
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p* 



and the power values from the ((io, jo) + l)-th to the (i s+ j, M)-th communication blocks are 
identical, denoted as P±. Due to Proposition 14.11 we only need to search Po over the region 
V = [0, Po]/[P&, max(P&, Po))- Then, P is given as the optimal point of the following one- 
dimensional outage probability minimization problem 

n = min P(P) + k Q F f P + ^— . (32) 

Furthermore, the power values from the (io,jo + l)-th to the (N, M)-th communication blocks 
are given as 

Pi=Po + ^f^. (33) 
fc 

Therefore, the optimal power allocation from the i-th to the i s+ ^-th EH periods is given as 

0, (i,l)<(p,q)<(i ,jo)-l 

Po, (p,q) = (k,jo) , (34) 

^ Pi, (t ,jo) + l< (P,q) < (i s+ t,M) 
where (n, m) — 1 is defined as the index of the previous communication block before the (n, m)-th 
one. 

b) If such a to exists to satisfy (|27T ). we claim that the only positive optimal power value below P a 
may appear among the i-th to the i s+ ^-th EH periods, with i = to, whose index (io, jo) can be 
computed by using (128T ) and (l29l ) with t = to- Accordingly, Po and Pi can also be computed by 
using (l32l and (l33l . respectively. With the obtained parameters, we need to further check whether 
they are optimal. To do this, we should check whether Steps ( |2(b)i I and ( 2(b)ii[ ) below are satisfied 
or not, and update the parameter t for which the result in Case 2) of Theorem 13. II can be applied 
(If it is updated, a larger-scale search is needed.) and the corresponding power allocation profile. 

i) If (io, jo) = (i s +p or Pi > P i+ i +l , we should further search over the i-th to the i s+ ^ +1 - 
th EH periods. It is noted that: (1) If the former subcase happens, the total sum harvested 
power up to the i s+ ^-th EH period is less than P&, which means that we actually have not 
done the one-dimension search (as in Case 2) of Theorem 13.11 ) from the i-th to the i s+ f~th 
EH period, and thus we need to enlarge the searching scope to find the optimal solution; and 
(2) if the latter subcase happens, it cannot be optimal due to the fact that if Pi > P i+ ^ +1 , 
we can save power for the (i s+ i+ l)-th to the i s+ j +1 -th EH periods to decrease the average 



outage probability, since over the power regime 
is convex. 



Pi + t+i,Pi 



, the outage probability function 
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Then, we update t = t + 1, and compute Pq and Pi again by using (OTT ). (|32~1 ). and (f33H 5 



We repeatedly check whether the above conditions are satisfied or not by the newly obtained 
(^O)Jo)' ^b> an d Pi> untl l tne N-th EH period. If the iV-th EH period is reached, we claim 
that the obtained power allocation profile is optimal; otherwise, we go on to check the next 
Step ggjgi) . 

ii) If (io,jo) < {is,M), Pi < P i+ j +1 , and Pq > ko(P i+ ^ +1 — Pi), it is claimed that the obtained 
(*0) Jo) is the location of the last communication block with power value less than P&, while its 
corresponding power value Pi j may not be optimal. Under this condition, it can be shown that 
the optimal power value should satisfy P* 0t j < Pi ,j - Thus, as we decrease Pi j = Pq by A, 
< A < Pq, and correspondingly increase P± by j^-, we can possibly make Pi + ^ > P i+ ^ +1 
for some A, which means that a larger-scale search (up to the i s+ £, j-th EH period) may help 
with decreasing the outage probability. Since it can be shown that the obtained (io,ja) are 
fixed, Pi j can only be changed over the region [0, Pq]. 

Next, we try this larger-scale search, and check whether it is optimal. We initialize a variable 
temp = t, and use it to store the index corresponding to the search with the lowest outage 
performance. Then, let t = t + 1, and update the parameters Pq and Pi again by using (f3TT >. 
(|32~1 ). and 03]). We claim that only when both of the following two conditions are satisfied, 
this search can improve the outage performance, and update temp = t: (i) The EH constraint 
at the {i s+ t_i, M)-th communication block should be satisfied by the newly obtained power 
profile, i.e., 



Po + ((Vk_! - k + 1)M - jo) Pi < M £ Qi- (35) 

i=l 

This is due to the fact that in (l30l ). we allocate the power without checking the feasibility of 
this constraint; and (ii) the newly derived power profile leads to a smaller outage probability 

over the i-th to the i s+ ^th EH periods, i.e., 

t 

Ptemp / \1s-\-r ^s-\-r— 1 

) MT{P l+r ) > p~ t . (36) 

r=temp+l 



We should repeat step ( |2(b)ii| ) until either the iV-th EH period is reached or the above conditions 
(i)-(ii) are not satisfied. Then, temp provides the value of t as needed, i.e., let t = temp, and 
go to Step ( |2(b)iii| ); 



5 Here, we do not need to update (io, jo), since both the previously obtained Pi and P i+ i +1 can be shown to be larger than 

Pa- 
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iii) Now, we use the obtained value of t to compute the optimal solution as given by (l34l) . 
Then, Step d2bl is finished. Let i = i s+ i+ 1, and repeat the searching procedure. 
Since there is at most one communication block with power value less than the searching procedure 
for Step (l2bl needs to be implemented only once. As such, if this case has occurred, we can repeat 
the searching procedure in Case 1) only. It is easy to verify that the optimal solution of Problem (PI) 
obtained by Algorithm |n]is non-decreasing over time, and corresponds to a "save-then-transmit" structure: 
When the source initially does not have sufficient power, i.e., much smaller than P a , to support the 
communication rate R with low outage probabilities, it keeps silent to save energy until the cumulated 
power become sufficiently close to P a ; afterwards, it starts transmitting continuously with non-decreasing 
power. 



AlgorithmQTJ Compute the optimal non-decreasing power profile for Problem (PI) with N > 1. 

1) Compute P a by Algorithm |U and initialize i = 1 and temp — 0; repeat 

2) Compute i s and Pi by d22t and l !23t . and check 

1) If Pi > P a , the optimal power profile is given by d24b . and let i = i s + 1; 

2) If Pi < P a , recursively compute i s and Pi by using J25b and J26l l. respectively. Then, check whether to > 1 exists to 
satisfy j27\ or not: 

1) If to does not exist, let i s+ i = N and compute Po and Pi by d32t and ( 133b . respectively. Then, the optimal power 
allocation is given by 04t . and let i = N + 1; 

2) If to exists, do the following operations 

1) Let t = to, and compute Po and Pi by d32b and l |33t , respectively; 

2) While i B+ i< N and ((i ,jo) = (i s+ i,M) or Pi > P l+f+1 ), repeat: 



TABLE II 




Let t = t + 1, and update Po and Pi by d32b and l !33t . respectively. 



3) Let temp = t; 



4) While i s+ i < N and P > fc [P i+ t+i -P)> repeat: 

Let t = t + 1, and update Po and Pi by ([32) and l |33K respectively. If conditions d351 > and l |36t are true, let 
temp = t, and repeat this step. 



5) Update t = temp, and compute Po and Pi by d32b and d33t . respectively. The optimal power profile is given 
as l |34| l, and let i = i s+ f + 1. 



3) Until i > N. 



Theorem 4.1: The solution obtained by using Algorithm HTl is optimal for Problem (PI). 
Proof: See Appendix ICl 
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Remark 4.2: In |2), (H, the authors studied the power allocation problem to maximize the throughput 
over AWGN channels with non-causal ESI, where the throughput function is assumed to be concave. 
The optimal power profile for the throughput maximization problem is shown to have a continuous, non- 
decreasing, and piecewise-constant structure. In this paper, we consider a different problem by minimizing 
the outage probability over fading channels with non-causal ESI, which is non-convex due to the concave- 
convex shape of the outage probability function (Type B). Our results show that an on-off transmission 
strategy is optimal, for which the source should only transmit when the available power is sufficiently 
large. It is worth noting that our problem will degrade to the one considered in 0, (4J if the convex 
Type A outage probability function is considered. 

Remark 4.3: In Algorithm JIJ it is observed that exhaustive searches are needed to solve the opti- 
mization problem defined in ( f32b . Since we need to repeat the one-dimensional search in Step ( 12.2.21 ) 
of Algorithm |II1 these search operations are executed at most N times. Note that except these one- 
dimensional searches, the computation complexity of Algorithm [TT] is on the order of 0(N 2 ) (see dHJ 
and d25l)). Thus, the main computation burden of the proposed algorithm is due to the one-dimensional 
searches in d32l . However, compared to searching exhaustively the optimal power allocation of Problem 
(PI) over the total number of NM communication blocks, the computation complexity is greatly reduced 
with the proposed algorithm. 

Remark 4.4: By a similar argument to Remark [3741 the power allocation profile given in Algorithm HTl 
converges to the following threshold-based transmission scheme as M — > oo: At the i-th EH period, first 
use (l22T>-([23~b to compute the possible transmission power Pi. If Pi is no smaller than P a , we transmit with 
power Pi over the i-th to the i s -th EH periods; otherwise, keep the first k = (1 — -p L )(i s — i + 1)M 



{i B -i+l)M 

LLL VV ILli ^J\J VV V— 1 

blocks from the i-th to the z s -th EH periods. 



communication blocks silent and then transmit with power , (ls \ '- — =P, over the rest communication 

F {i s -i+l)M-k % 



B. Suboptimal Offline Power Allocation with N > 1 

In this subsection, we propose a suboptimal algorithm for Problem (PI) with lower complexity than 
that of Algorithm [TTJ and show that it is asymptotically optimal as M goes to infinity. 

Similar to the case of N = 1 in Section III-C, we propose a suboptimal power allocation algorithm, 
namely Algorithm ITTT1 for Problem (PI) with N > 1, which is shown in Table UlTl The main idea of this 
algorithm is described as follows. From the first EH period, we search the index of the next possible 
power exhausting EH period by d22l) and d23l ). If Pi > P a , we claim that the source should transmit with 
its best effort, i.e., the power allocation is given as (1241 ); otherwise, an on-off transmission is adopted to 
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guarantee that the allocated power is equal to or larger than P a . The power allocation is thus given as 

0, (i,l) < (p,q) < (to, jo) 

k ^'"t (*o.io)<(p,9)<(i s ,M) 
where io> Jo> and &o are computed by (l28l ). d29b , and (f30b . respectively. 

Note that from the z-th to the i s -th EH periods, the power profile is obtained by the sub-optimal 
solution proposed in Section III-C with N = 1, while in Algorithm [Till we still use (l22l and (l23l to 
determine i s as in the optimal solution given in Algorithm ITT] 

TABLE III 

ALGORITHMQTjl SUBOPTIMAL POWER ALLOCATION FOR PROBLEM (PI) WITH N > 1. 

. Set i = 1; 

• While i < N, repeat the following steps: 

1) Compute Pi and i 3 by using (22) and <23>; 

2) If Pi > P a , the power allocation is given by J241 > ; otherwise, the power allocation is given by J37b . 

3) Let i = i s + 1. 

• Algorithm ends. 



Proposition 4.3: The solution obtained by Algorithm [TTT1 is asymptotically optimal for Problem (PI) 
with N > 1 as M goes to infinity. 

Proof: The proof is similar to that of Proposition 13.51 for N = 1, and thus omitted for brevity. ■ 

V. Online Power Allocation 

In this section, we consider Problem (P2) for the case with only causal ESI at the transmitter and 
N > 1. First, we show that the optimal solution of Problem (P2) can be obtained by applying dynamic 
programming and the results in Section III for the case of = 1. Then, we propose a suboptimal online 
power allocation algorithm with lower complexity than the optimal online solution. 

A. Optimal Online Power Allocation 

In general, the optimization of Pij for Problem (P2) with N > 1 cannot be performed independently 
over each EH period, since the battery states defined in (0 are coupled over time. Thus, we adopt a 
dynamic programming method to solve this problem, as stated in the following proposition. 

Proposition 5.1: For Problem (P2.n), 1 < n < N, and the given initial states Q n and B n = B n> i, the 
minimum average outage probability T* is given by J n (Q n , B n ), which can be computed recursively 
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from Jn{Qn, Bn) to Jn-i{Qn-i, Bn-i), until J n (Q n ,B n ). The sequence of optimization problems 
are constructed as: 

M 

(P4.iV) J N (Q N ,B N ) = min Vj(P Nj ) (38) 

M 

s.t. ^Pjv,i<^ + MQ^, (39) 



and for 1 < i < N, 



M 



(P4.i) J i (Q i ,B l )= min min ^ 7" (P^) + J i+1 (Q,, i? m ) (40) 

M 

s.t. J^Pij <Bi-B i+1 + MQi, (41) 
where P« = P^i, and 

J i+ i(Qi,Pi+i) = Eq. +1 [J i+1 (Q i+1 ,P i+1 )| Qi] . (42) 

Proof: The proof directly follows by applying the Bellman's equation [18] and using Note 
that in each Problem (P4.i), there should be M EH constraints, i.e., YllLi Bi,j < P« — Pj+i + mQi, 
1 < m < M; however, by a similar argument as in Section III-B, we could eliminate the first M — 1 
EH constraints by finding an optimal solution Pij in a non-decreasing manner. ■ 
Note that Problems (P4.z), 1 < i < N — 1, can be solved by first applying Theorem 13.11 with fixed 
Pi+i, and then searching over all possible Pj + i's, with < Pj+i < Bi + MQi. Therefore, the above 
MDP problems can be solved by dynamic programming and applying our previous results for the case 
of N = 1. 



B. Suboptimal Online Power Allocation 

In this subsection, we propose a suboptimal online power allocation algorithm called "^-period look- 
ahead", which is based on the current battery state and the predicted power to be harvested for the next 
q — 1 EH periods, with q > 2. 

We assume that the EH process {Q{\ is a discreet-time first-order Markov process, and the future ESI 
can be predicted as 

Qj = E (Qj\Qi) , i + 1 < j < min {J + q - 1, N} , (43) 

where the integer q indicates the prediction window length from the current EH period. Here we only 
assume that the mean values of the future harvested energy are known, while the exact distribution may 
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Fig. 3. Outage probability over the Weibull fading, with — 8 and = 3 bits/sec/Hz. 

not be known to the transmitter, which greatly relaxes the requirements for computing the online power 
allocation. 

Then, with the current energy profile Qi = Qi + % and the predicted ones, Qj, i + 1 < j < 
mm{i + q — 1,N}, we compute the power allocation by using either the optimal or the suboptimal 
alogrithms, i.e., Algorithm [HI or ED and thereby adopt the power allocation for the current z-th EH 
period, i.e., from the (i,l)-th to the (i,M)-th communication blocks. Similarly, at the next EH period, 
we repeat the above procedure to obtain its corresponding power allocation, until the iV-th EH period is 
reached. Evidently, if q = 1, the proposed scheme becomes a "greedy" power allocation, i.e., at the end 
of each EH period, all the stored harvested energy is used up. In the next section, we will evaluate the 
performance of this suboptimal online algorithm. 

VI. Numerical Results 
For the purpose of exposition, we consider Weibull fading with /3 = 8 throughout this section. 

A. The Case of N = 1 

In this subsection, we show some numerical results to validate our analysis in Section III for the case 
of N = 1. In Fig. [3l we plot the outage probability vs. average transmit power with different numbers of 
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Fig. 4. Outage probability comparison for the optimal and suboptimal power allocation schemes, with j3 
R = 3 bits/sec/Hz. 



h = 9, and 



communication blocks, M. It is observed that the outage probability with the optimal power allocation is 
no larger than that with uniform power allocation over the region Q± < P a . In particular, the minimum 
outage probability with the optimal allocation for the case of M — > oo over this region is a straight line 
connecting the points [0, 1] and [P a , P(P a )]. Moreover, as M increases, the minimum outage probability 
converges to that with M — > oo. 

In Fig. |U we plot the average outage probability versus M with both the proposed optimal and 
suboptimal power allocation schemes. It is observed that the outage probabilities of both schemes converge 
to the same value as M goes to infinity, which is in accordance with Proposition 13.51 

B. The Case of N > 1 

In this subsection, we compare the performance of the proposed offline algorithm against that of the 
online power allocation algorithm, for the case of N > 1 with non-causal versus causal ESI, respectively. 
We assume an i.i.d. model for the EH source, where the harvested power at each EH period has three 
equal-probability states: 0, P, and 2P, with P the average harvested power value. For simplicity, we 
also assume that M = 1 and N = 20. As shown in Fig. |5l we plot the outage probability of different 
algorithms with P. As a good approximation for the continuous-state MDP problem in ([8]), we model 
the battery states as a finite set, where the difference between two adjacent states is set as 0.01. It is 
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Fig. 5. Comparison of various power allocation algorithms, with R = 0.5 bits/sec/Hz, N = 20 and M — 1. 

observed that the optimal online algorithm performs very close to the optimal offline algorithm. For the 
"g-period" look-ahead algorithm, we choose three values for q: q = 1, q = 2, and q = N. It is observed 
that a properly chosen p may yield a better outage performance, e.g., in Fig. \5\ the 2-period look-ahead 
scheme outperforms the other two cases over most of the P values. 

VII. Conclusion 

In this paper, we studied the optimal power allocation to minimize the averaged outage probability 
in fading channels with EH constraints. We showed that for most of practical fading channels, the 
outage probability function is in general non-convex over the transmit power, which results in non- 
convex power allocation problems. We derived the globally optimal solutions for such problems by 
exploiting some interesting properties of the outage probability function and the causality structure of the 
EH constraints. It was shown that the optimal offline power allocation follows an interesting "save-then- 
transmit" protocol. For the special case of N = 1, our results revisit the classic outage capacity problem 
with new observations. Furthermore, we considered the practical case with only causal ESI and proposed 
both optimal and suboptimal online power allocation schemes by applying dynamic programming and 
exploring the structure in the offline solution. 
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Appendix A 
Proof of Proposition 13.21 

To prove this proposition, we draw a line passing through (0, 1) and any other point (P, F(P)) on the 
outage probability curve defined in (TTTb . and denote its slope as S(P), P > 0. Then, we can prove that 
the slope of this line is lower-bounded, which means that the desired point can be found corresponding 
to this lower bound. 

To see this point, we check the slope function: 

S(P) = HP) p ~ l , P>0. (44) 

It is observed that limp^+oo S(P) = 0, since the numerator is always bounded. In addition, limp^o S(P) - 
0, since exp ^— ^ ^p" 1 ) ^ is a higher order infinitesimal of P for P — > 0. Then, for a large enough 
value M > 0, we conclude that: 1) If we further define 5(0) = 0, S(P) is both upper- and lower- 
bounded over [0, M], since it is a continuous function over this region; and 2) S(P) is lower-bounded 
over [M, +00), since it is increasing over this region (note that S(P) is always non-positive). Based on 
the above results, this proposition is proved. 

Appendix B 
Proof of Theorem 13. II 

To avoid tedious mathematical description for the proof, we show the validation of this theorem by 
some geometrical properties of the involved functions. First, we present the following lemma. 
Lemma B.l: For the following function 

1 



fk+i(P) 



k + l 



F{P) + kT 



( MQx - P 

V k 



(45) 



where < P < j^pt and k is chosen from the set {1, • • • , M — 1}, its minimum value is attained at 
P = 0, if MQi < Pa ; or at P = MQ±, if ^ > p a 

Proof: Consider the following k + l power values: Pi = P, with < P < -fij^, and P 2 = • • ■ = 
Pk+i = M ®k~ P > f° r which the average power is Q±. Here, without loss of generality, we assume that 
if Pi = 0, then P2 = S2. As shown in Fig. [6j the corresponding average outage probability of these 
power values is given by the intersection point T a of the line x = Q\ and the one connecting the 
points (Pi,P(Pi)) and (P 2 ,P(P 2 )). It is observed that if < p o> t h e minimum value is achieved 
at P = 0, since the point T a is always above the line connecting the points {S2, P{S2)) and (0, 1), for 
< x < Similarly, we can show that the second part of this lemma is also true. ■ 
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Fig. 6. Illustration of the optimal solution of Problem (PI). 



Next, we prove Theorem 13.11 From Remark 13.21 it is sufficient that we only consider the non-zero 
values of the optimal power allocation: one block with Pq and k blocks with identical Pi = M( ^ 1 ~ p ° ; 



as 



1 < k < M, where < P < f^-. As shown in Fig. H the power values {Sk} are defined 
S k = MQl, k = I,-- - ,M, with S M = Ql If we connect the points (S k ,T(S k )) and (0,1) for 
1 < k < M, the obtained segment intersects with the line x = Q± at the point T k = (Qi,Pk), where 
P k = ~M ' fk{ M k % ) + M — k). It can be shown that: i) p k is the average outage probability if we 



allocate the power as Pj = 0, j = 1, • • ■ ,M — k, and Pj = Si, j = M — k + 1, ■ ■ ■ , M; and ii) by Lemma 
ED it follows that p M > Vm-i > ■ > Pk +i and p ko < Pk -i < ■ ■ ■ < pi, where k is given by (QJ]>. 
Moreover, by Lemma IB- 1 1 we know that the average outage probability of any other power allocation 
in the form of Pj = 0, j = 1, • • ■ ,M — k — 1, P M -k = ?o, and Pj = P\, j = M - k + 1, • • ■ , M, is 
lower-bounded by pk for k = ko + 1, • • • , M and pk-i for k = 1, • • • , /cq. Thus, the optimal Pq is given 



by searching over 



n Mfo. 

u ' k +l 



for ([191). Due to Proposition [33 it follows that P € 



A, g§) cannot be 



optimal. Therefore, the optimal Pq is given by ( fT9l ), and Theorem 13.11 is proved. 
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Appendix C 
Proof of Theorem 14. II 

Denote the optimal solution of Problem (PI) as {P*j}, and the power profile obtained by Algorithm 
JI] as {P£ A. For {P^A, we denote the indices of the power changing blocks as (1,1) < (£i,ji) < 
••• < {inijn) < (*n+i)in+i) = (N,M), which means that from the (1, l)-th to the — l)-th 

communication block, we have P*a = 0, and from the (ik-i, ife-i)-th, 2 < k < n+1, to the ((ik,jk) — 1)- 
th communication blocks, the optimal power values P*j's keep identical. To simplify the proof, we assume 
that («2 , J2) = + 1> and denotes the location of the one possible communication block 

with power value less than Pj,; however, for the case that all positive power values are no smaller than 
Pi, this assumption will not introduce any trouble in the following proof. Moreover, by Proposition 14.21 
we know that the EH constraint at the ((ik,jk) — l)-th, 3 < k < n + 1, communication block is satisfied 
with equality. Similarly, we define the indices of the power changing blocks for the power profile {P*j} 
as {(i' k , j' k )} for < k < m. 

We assume that before the (p, q)-th communication block, the above defined two power profiles are 
the same, and their first difference appears at the (p,q)-th communication block, i.e., P* ^ P* g . Then, 
we consider the following three cases: 

1) If (p,q) < (h,jx), it is easy to see that P* q = and only P*, y = P* >q > P* q can occur. There 
are then three possible subcases: 

a ) If (*3>J3) > (*3,J3), it is easy to see that there exists with (i'2,3'2) < (i°,3°) < fe, J3) 
such that P* -o < P* jo, since the EH constraint at the (i^,j-^)-th communication block is 
achieved with equality for {P*j}. Then, it follows that P*^^ = P*o :j0 < P-o^o = Pt 3 ,j 3 -i < 
P*> j'-iS where the first equality is due to the assumption that {P*j} keep identical among the 
(i 2 ,j' 2 )-th to the ((^3, j'A — l)-th communication blocks. Thus, by the obtained P£ < P^ 

it is easy to see that for {P*j}, the EH constraint at the ((i 3 , j 3 ) — l)-th communication block 
cannot be achieved with equality, which contradicts with the assumption. Therefore, this subcase 
cannot occur. 

b) If (i' 3 , j 3 ) = («3, J3), it is obvious that {P*j} cannot be optimal due to the search procedure of 
Algorithm [TT] and Theorem 13.11 

c) If (i 3 ,i 3 ) < (23, J3), we check the power profiles from the (i' 3 ,j' 3 )-th to the ((i 3 ,j 3 ) — l)-th 
communication blocks, and denote the index of the last power changing block within this region 

6 Pn,m-i denotes the power of the ((n, m) — l)-th communication block, similar for P n ,m+i- 
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for power profile {P*j} as (i°,j°). First, we show that P* s J - 3 _ 1 < P* j 3 „i- This can be proved 
by contradiction: Assume that P* 3 • 3 _ 1 > Pj* j3 _i, and by the non-decreasing property of {P*j}, 
it follows that P*. = ^* 3j3 _ 1 > P£ jW > P*. for (i°,f) < < ((i 3 ,j 3 ) - 1), or in other 
words, 

E nj> E >>,■ (46) 

(i°,i )<(i,i)<((fe,i3)-i) (i°,i°)<(ij)<((fe,i3)-i) 
Since at the ((i°,j°) — l)-th communication block, the EH constraint is achieved with equality 

for {P*j} and may not for {PA}, it is obtained that 

E P iJ< E <?i< E P tr ( 47 ) 

(i°,j )<(hj)<((i3,h)-l) (i°,j")<(i,j)<((i3,ja)-l) (i° ,j°)<(i ,j)<((t 3 J 3 )-l) 

which contradicts with ( f46l >. Therefore, we conclude that P-* ■ , < P„* ■ , . 
Then, we claim that for {ffj}, the EH constraint at the ((^3,^3) — l)-th communication block 
is achieved with equality. We prove this result by contradiction. Assume that for {P*j}, the EH 
constraint at the ((^3, j'3) — l)-th communication block is not achieved with equality. Thus, by 
Proposition 0~2 it follows that ^* 3ii3 _i = P* 3 j 3 . Moreover, since P* h > Pf^-x > P* 3 , js -i = 
P* 3 - a , it follows that for {P*j}, the EH constraint at the (^3, j3)-th communication block is not 
achieved with equality. Repeat the above argument, and we conclude that for {P*j}, the EH 
constraint after the ((23, J3) — l)-th communication block is not achieved with equality, which 
means that {P*j} cannot be optimal and shows the contradiction. 

Finally, we only focus on the (1, l)-th to the ((23, j'3) — l)-th communication blocks. Since for 
both {P*j} and {P*j}, the EH constraint at the ((^3, j'3) — l)-th communication block is achieved 
with equality, we can apply the result in Theorem 13. II and show that {P*j} is not optimal. 
2) If (p,q) = (h,ji), we consider the following two sub-cases: 

a) P* > P* : This case cannot be optimal due to similar arguments as those in Case [Tj. 

b) P* < Pp q- For this case, we consider the following subcases: 

i) P* > 0: Compared to {P*,-}, the power profile {P*,} saves some power at the (p,q)-th 
communication block. It is easy to see that the saved power with the amount P* — P* 
is allocated to the blocks after the one with index (ii,jx) in a "waterfilling" manner with 
the baseline given by {P*j}, > (.h,ji)'- First, we equally allocate P* q — P* q to the 
blocks with the indices from (12,32) to (^3, j'3) — 1 (due to Proposition 14.21 ). and still keep 
these blocks with identical power allocation. Only when the newly obtained P*-, (12,32) < 
(i,j) < (*3jj3) — 1> exceeds the power values of the blocks with the indices from (23, j'3) 
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to (^4, j'4) — 1, the power values of the blocks from (22, J2) to (u, j'4) — 1 should be maken 
identically, and so on. In other words, we claim that there exists k, 3 < k < n + 1, such 
that (ik,jk) = (^3) jjs)- Thus, for {P*j}, the power allocation problem from the )-th 
to ((*3, J3) — l)-th blocks corresponds to one single iteration in Step (12.2.2.41) of Algorithm 
HR which is shown to be not optimal by the searching procedures, 
ii) P* q = 0: We define a new power allocation problem starting from the (*2 , j2)-th to the 
(N,M)-th communication blocks by setting Pjj = 0, < {12,32) for Problem (PI). It 
is easy to observe that: (A) for the optimal power profile of this newly defined problem, all 
power values are no smaller than P b , since Ffj > P b , > {12,32)', and (B) there exists 
k, 3 < < n + 1, such that the optimal power profile of the newly defined problem after 
the (ik, jfc)-th communication block is the same as the corresponding part of {P*j} (due to 
similar argument as Case (12.b.il) ). Thus, by (A), we conclude that the optimal value of the 
newly defined problem is no larger than the average outage probability given by {P*j} (note 
that the power allocation of the newly defined problem is operated on the convex region of 
its objective function and the arguments of Theorem 1 in (H can be applied to show this 
result); by (B), considering the average outage probability minimization over the whole NM 
communication blocks, we conclude that {P*j} outperforms the power profile obtained by 
solving the newly defined problem (Since the newly defined power allocation problem is 
only a special case of the last iteration of Step (12.2.2.41 ) in Algorithm HT1 by choosing P = 
in d32b). Thus, this case cannot be optimal. 

3) If (p,q) > it follows that P*- > P b and P*j > P b for > (p,q), which means that the 

power allocation is always in the convex regime of the objective function. By a similar argument as 
Theorem 1 in O, we know that this case cannot occur. 
By combining the above discussions, Theorem 14.11 is proved. 
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